System for describing markup language for mobile use, and information processing apparatus and program for generating display content

ABSTRACT

An image to be displayed is divided into partial images. The partial images are arranged so that they have the same positional relationships as operation keys of an image display apparatus. Operating an operation key causes an enlarged version of a partial image in a corresponding position to be displayed.

FIELD OF THE INVENTION

[0001] This invention relates to a system for describing a markup language for mobile use, and an information processing apparatus and program for generating a display content.

BACKGROUND OF THE INVENTION

[0002] Today the Internet can be used through mobile phones.

[0003] Some browsers installed in commercially available mobile phones adopt HTML for mobile devices called COMPACT-HTML (COMPACT-HyperText Markup Language) established by W3C (World Wide Web Consortium), which establishes standards for the Internet.

[0004] In COMPACT-HTML, a ten-key number called an access key may be assigned to a link tag in HTML so that the link can be designated by a ten-key of the mobile phone. Designating a ten-key number allows jumping to a specific link in one key operation and eliminates the efforts to move a cursor key to a link position and to select the link with an OK button.

[0005] When an image display service is provided for a small information device such as a mobile phone having a COMPACT-HTML browser, a server has to reduce the size of an image to the mobile phone's display size and send the reduced image to the mobile phone.

[0006] However, the image reduced for display on a small display unit of the mobile phone may be hard to view due to the size reduction. Further, when a part of the image is interested in, the server has to generate an enlarged version of the whole image for enlarged display and send it to the mobile phone. Furthermore, the mobile phone has to again receive the whole image for enlarged display in order to display only a part of the image. This involves problems in various aspects, such as the time required for reception, a communication charge, communication resources, and memory resources, for the user who has to receive the whole enlarged image from the server although he wants to enlarge only a part of the image.

[0007] To solve these problems, it may be contemplated to specify the part to be enlarged and cause the server to enlarge only that part and send it to the mobile phone. However, the problems are that there is no way to specify the part to be enlarged, and that if the part is actually enlarged and displayed, it is hard to know which part of the original whole image is being displayed.

SUMMARY OF THE INVENTION

[0008] An object of the invention is to provide an intuitive and simple key operation for enlarged display of a part of an image, and to thereby enhance operability.

[0009] To realize these objects, according to an aspect of the present invention, an apparatus for outputting an image comprising dividing means for dividing an image so that one of partial images can be selected with a ten-key; and output means for outputting the one of the partial images selected with the ten-key, wherein the dividing means divides the image based on an image size and a screen size.

[0010] According to another aspect of the present invention, a method for outputting an image comprising the steps of dividing an image so that one of partial images can be selected with a ten-key; and outputting the one of the partial images selected with the ten-key, wherein the step of dividing comprises dividing the image based on an image size and a screen size.

[0011] According to another aspect of the present invention, an apparatus for outputting image data comprising dividing means for dividing an original image into partial images so that one of the partial images can be selected with a ten-key; and output means for outputting a first image data for displaying the one of the partial images selected with the ten-key, wherein the output means outputs a second image data for displaying the whole of the original data in response to a ten-key operation performed when the one of the partial images is displayed.

[0012] According to another aspect of the present invention, a method for outputting image data comprising the steps of dividing an original image into partial images so that one of the partial images can be selected with a ten-key; and outputting a first image data for displaying the one of the partial images selected with the ten-key, wherein the step of outputting comprises outputting a second image data for displaying the whole of the original data in response to a ten-key operation performed when the one of the partial images is displayed.

[0013] Other features and advantages of the present invention will be apparent from the following description taken in conjunction with the accompanying drawings, in which like reference characters designate the same or similar parts throughout the figures thereof.

BRIEF DESCRIPTION OF THE DRAWINGS

[0014] The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate embodiments of the invention and, together with the description, serve to explain the principles of the invention.

[0015]FIG. 1 shows a network configuration for describing an embodiment of the invention;

[0016]FIG. 2 shows a mobile phone and a ten-key unit used in describing the embodiment of the invention;

[0017]FIG. 3 describes a relationship between an accesskey attribute in HTML and ten-keys for describing the embodiment of the invention;

[0018]FIG. 4 shows an exemplary display of a partial reduced image group for an image in the embodiment of the invention;

[0019]FIG. 5 shows an exemplary enlarged display of a partial image in the embodiment of the invention;

[0020]FIG. 6 shows relationships between partial reduced images and the ten-keys in the embodiment of the invention;

[0021]FIG. 7 shows a configuration of a web server in the embodiment of the invention;

[0022]FIG. 8 shows a software configuration of the web server in the embodiment of the invention;

[0023]FIG. 9 is a flowchart of an operation performed by the web server in an First Embodiment of the invention;

[0024]FIG. 10 is a flowchart of an operation performed by the web server in the First Embodiment of the invention;

[0025]FIG. 11 is a flowchart of an operation performed by the web server in an Second Embodiment of the invention; and

[0026]FIG. 12 is a flowchart of an operation performed by the web server in the Second Embodiment of the invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0027] Now, embodiments of the invention will be described with reference to the drawings.

First Embodiment

[0028]FIG. 1 is an overview of a network configuration adapted for describing the Fist Embodiment of the present invention.

[0029] In FIG. 1, the network is configured such that a mobile phone 1 can cooperate with a mobile phone gateway (referred to as a mobile phone GW hereafter) 2 to connect to a web service system 6. The mobile phone 1 has installed a mobile phone browser and is capable of displaying images. The mobile phone GW 2 is provided by telephone companies and enables the mobile phone 1 to connect to the Internet, private line services, and so on.

[0030] The web service system 6 includes a web server 3 on which applications can operate, a database (referred to as a DB hereafter) 5 that stores data required for web services, such as information on connectable devices and access authorization data, and an image database (referred to as an image DB hereafter) 4 that stores original images to be displayed on the mobile phone 1.

[0031] The mobile phone browser of the mobile phone 1 implements HTTP (HyperText Transfer Protocol) operable on TCP/IP (Transmission Control Protocol/Internet Protocol) The browser enables connection to the web server 3 and content display through the mobile phone GW 2.

[0032]FIG. 2 schematically shows the mobile phone 1.

[0033] The mobile phone 1 has a display screen 10 capable of displaying information provided by the browser, and an alphanumeric ten-key unit 11 used for inputs of phone numbers, e-mail addresses, e-mail texts, and so on. The ten-key unit 11 includes minimum numeric keys 1 to 0 required for making calls, as well as pound and asterisk keys.

[0034]FIG. 3 describes a relationship between HTML and the ten-keys.

[0035] In the above-described HTML called COMPACT-HTML, an attribute called accesskey is available to reduce key operations on a device such as a mobile phone or a PDA (Personal Digital Assistant) used in a mobile environment. In COMPACT-HTML, describing the accesskey attribute in an available tag allows an operation for the tag to be performed simply with a press of a ten-key of a designated number.

[0036] An example of how to describe this will be described with the ten-keys 11 and a sample COMPACT-HTML 14.

[0037] When it is desired to jump to (select and display) a certain link destination, the accesskey attribute and a ten-key number to be designated may be described in the anchor tag for link information, <A HREF=“link information”>. As shown in FIG. 3, if the ten-key number to be used as an access key is “3” and the link destination is “link information”, the tag is described as <A HREF=“link information” ACCESSKEY=“3”>.

[0038] In this manner, while the HTML page is displayed, a press of the key 3 in the ten-keys 11 provides a jump to the link information assigned to the access key “3”.

[0039] By such a simple description, a press of a key can replace operations that would be performed for a browser operated on PC, such as the key operations of moving a cursor to a link and selecting it with a return key, or the mouse operations of selecting and clicking a link. Therefore, this is a convenient function for small devices with poor input interfaces.

[0040] How to actually use the access key in this embodiment will be described with reference to FIG. 4 and the following figures.

[0041]FIG. 4 shows the display screen 10 of the mobile phone 1 displaying a group of partial images 15 aligned in the same way as the ten-keys 11. The partial image group 15 represents an original image divided into nine parts in the same arrangement as the keys “1” to “9” in the ten-keys 11 and scaled so that the whole image is displayed on the screen. The partial images are aligned by TABLE tags and displayed.

[0042]FIG. 5 shows an enlarged display of a certain image 20 in the partial image group 15 (in this embodiment, an image corresponding to the position “7” in the ten-keys 11). This image 20 is displayed with a press of the ten-key “7” (26).

[0043] That is, as shown in FIG. 6, “1” in the ten-keys 11 is associated with a partial image 61 in the partial image group 15 as its access key. Similarly, “2” in the ten-keys 11 is associated with a partial image 62; “3” in the ten-keys 11 is associated with a partial image 63; “4” in the ten-keys 11 is associated with a partial image 64; “5” in the ten-keys 11 is associated with a partial image 65; “6” in the ten-keys 11 is associated with a partial image 66; “7” in the ten-keys 11 is associated with a partial image 67; “8” in the ten-keys 11 is associated with a partial image 68; and “9” in the ten-keys 11 is associated with a partial image 69. A press of each key causes an enlarged image of the corresponding partial image to be displayed on the display screen of the mobile phone 1 (see FIG. 5).

[0044]FIG. 7 shows a hardware configuration of the web server 3. The web server 3 has a CPU 71, an interface 72, and memory 73. The CPU 71 is a computer that operates according to a program stored in the memory 73. The interface 72 communicates with the mobile phone GW 2 and the DBs 4 and 5.

[0045] Now the process flow will be described.

[0046]FIG. 8 shows a configuration of software (the program in the memory 73) in the web server 3 of the web service system 6. Like PC browsers, browsers installed in mobile devices have User-Agent information. When a mobile phone connects to the server, the server receives the User-Agent information from the mobile phone and obtains information about which type of device (or its browser) is connecting. Based on the obtained User-Agent information, the server determines the screen size or image format that allows for display on a display screen of the connecting mobile phone. The server also stores the obtained information as customizable information in the DB 5 and customizes the size of an image to be displayed. For example, the server scales the image so that its size does not exceed the screen size that allows for display on the display screen of the mobile phone.

[0047] Specifically, when the mobile phone 1 connects to the web server 3, a device type determination unit 30 obtains device type information from the User-Agent information sent from the mobile phone 1. Then, a layout processing unit 32 retrieves the size of the display screen of the connecting mobile phone 1 from information stored in the DB 5 through a DB processing unit 34. The layout processing unit 32 determines whether the size of an original image to be displayed on the mobile phone 1 matches the size of the display screen of the determined device type.

[0048] If it does not match, an image processing unit 33 divides the image into partial images corresponding to the arrangement of the keys “1” to “9” in the ten-keys 11. The image processing unit 33 also generates thumbnail images (referred to as partial reduced images hereafter) by reducing each of the obtained partial images, for example, to {fraction (1/9)} of the display screen, so that all partial images are displayed on the display screen of the mobile phone. The layout processing unit 32 arranges the partial reduced images in the same way as the ten-keys 11. Then, the layout processing unit 32 generates HTML data in which corresponding keys in the ten-keys 11 are assigned to the partial reduced images as the access keys and provides the HTML data for the mobile phone 1 through an HTML output processing unit 31. Each of the obtained partial images is also scaled to the size of the display screen, and therefore partial images to be displayed in response to an enlargement operation by a ten-key (enlarged images) are generated. These enlarged images are defined as link destinations corresponding to the access keys assigned to the partial reduced images, and stored in memory (not shown) of the web server 3.

[0049] On the mobile phone 1, a group of the partial reduced images is displayed as shown in FIG. 4 based on the HTML provided by the web server 3. Then, the access keys may be used to display the enlarged images for the respective partial reduced images as shown in FIG. 5.

[0050] The process in FIG. 8 will be described using a flowchart of FIG. 9. This flowchart represents a part of the program stored in the memory 73.

[0051] Processing 1 starts with access initiated by a mobile device such as the mobile phone 1.

[0052] In step 40, the device type determination unit 30 determines the device type of the accessing mobile phone 1. In step 41, based on the device type, the layout processing unit 32 performs comparison with the image size suitable for display.

[0053] If the comparison in step 41 shows that the size of an original image in the image DB 4 can be directly applied to the display screen of the mobile phone 1 (that is, if the original image is of the same size as or smaller than the display screen of the mobile phone 1), the process directly proceeds to step 45. In step 45, HTML data is generated without scaling of the original image. The generated HTML data is output to the mobile phone through the HTML output processing unit 31 (step 46). Here, the whole image is displayed by default, because the image does not need to be enlarged. If the original image is larger than the display screen of the mobile phone 1 but can fit into the display screen with a predetermined reduction in size (for example, a reduction percentage of 30% or more), it is reduced by that percentage.

[0054] If the comparison in step 41 shows that the original image is larger than the display area of the mobile phone 1 and would require a significant reduction to fit into the display area (for example, a reduction percentage of less than 30%), the image processing unit 33 converts the image into a form that fits into the display screen of the mobile phone 1 of the determined device type by dividing and scaling the image as described above (step 42). The image processing unit 33 generates a group of partial reduced images in step 43, and generates enlarged images for the partial reduced images and stores them in the memory 73 in step 44. Then in step 45, based on the generated partial reduced image group, the layout processing unit 32 generates HTML in which the partial reduced images are associated with the ten-keys as described above. The HTML output processing unit 31 outputs the HTML to the mobile phone 1 in step 46 and allows the mobile phone 1 to display the HTML.

[0055] Thus, the user can transfer to the enlarged images by selecting the ten-keys from 1 to 9 that have their positional relationships associated with the partial reduced images.

[0056] When generating the HTML in step 45, the layout processing unit 32 sets link destinations for keys that are not defined as the access keys for the partial reduced images (the keys “0”, asterisk, and pound) to cause an alarm when pressed.

[0057]FIG. 10 describes processing performed by the web server 3 when a ten-key is pressed while the partial reduced image group as shown in FIG. 4 or an enlarged image as shown in FIG. 5 is displayed on the mobile phone 1. This flowchart represents a part of the program stored in the memory 73.

[0058] When a certain ten-key is pressed on the mobile phone 1, information on a link destination assigned to the pressed ten-key is sent to the web server 3. The web server 3 checks the link information (step 90).

[0059] If the link destination for the link information checked in step 90 is an enlarged display image (if one of the keys “1” to “9” in the ten-keys 11 is pressed while the partial reduced image group is displayed, or if a key for causing display of another enlarged image is pressed while an enlarged image is displayed), a corresponding enlarged image is retrieved from the memory 73 (step 91, 92), and HTML is generated for displaying the enlarged image (step 93). The generation of the HTML for displaying the enlarged image includes defining the corresponding key number as the access key for displaying the partial reduced image group so that the display returns to the partial reduced image group when the same key is pressed again. The generated HTML is then output to the mobile phone 1 (step 94). While the enlarged image is displayed, the reduced image group is temporarily stored in the memory 73 for a quick return to the display of the reduced image group.

[0060] If the link destination for the link information checked in step 91 is a reduced image group because the same key is pressed again after an enlarged image is displayed on the mobile phone 1 (for example, if the key “1” is pressed again after the key “1” is pressed to display a corresponding enlarged image), the partial reduced image group temporarily stored in the memory 73 is read (step 91, 96). Then, HTML for displaying the partial reduced image group is generated (step 93) and output to the mobile phone 1 (step 94).

[0061] If an enlarged image corresponding to the link destination for the link information checked in step 91 cannot be displayed (for example, if the key “0”, asterisk, or pound is pressed), an alarm message is generated for display along with the partial reduced image group (step 95). Then, HTML for displaying the alarm message along with the partial reduced image group is generated (step 93) and output to the mobile phone 1 (step 94).

[0062] Thus, according to this embodiment, if an original image to be displayed on the mobile phone is larger than the display screen of the mobile phone, the image is divided into partial images corresponding to the positional relationships among the ten-keys. Then, partial reduced images are generated from the partial images. The display screen of the mobile phone displays a group of the partial reduced images, to which the ten-keys are assigned respectively as the access keys for displaying corresponding enlarged images. This provides an intuitive and simple key operation for displaying the enlarged images for the partial reduced images, and thereby enhancing operability. Further, operation for returning to the display of the partial reduced image group is simple because it can be done only by pressing again a key used to display an enlarged image.

[0063] In addition, a press of a key that is not assigned to a partial image can be alarmed. This allows the user to easily know the keys that are not assigned to the partial images.

Second Embodiment

[0064] In the above First Embodiment, the partial reduced images and their enlarged images are generated and stored when the mobile phone accesses the web server. If the mobile phone requests display of an enlarged image by a ten-key operation, the enlarged image generated at the time of access by the mobile phone is displayed. In the Second Embodiment, only the partial reduced images are generated when the mobile phone accesses the web server, and the enlarged images are generated when the mobile phone requests them.

[0065] The network configuration for this embodiment is the same as in the First Embodiment and therefore will not be described.

[0066]FIG. 11 is a flowchart showing processing performed when the mobile phone 1 accesses the web server 3 according to this embodiment. This flowchart represents a part of the program stored in the memory 73.

[0067] The processing 3 starts with access initiated by a mobile device such as the mobile phone 1.

[0068] When the mobile phone 1 accesses the web server 3, the device type determination unit 30 determines the device type of the accessing mobile phone 1 (step 100). Then, the layout processing unit 32 retrieves the size of the display screen of the connecting mobile phone 1 from the information stored in the DB 5 through the DB processing unit 34. The layout processing unit 32 compares the retrieved size of the display screen of the mobile phone 1 with the size of an original image in the image DB 4 and determines whether the size of the original image to be displayed by the mobile phone 1 matches the size of the display screen of the determined device type (step 101).

[0069] If the comparison shows that the size of the original image in the image DB 4 can be directly applied to the display screen of the mobile phone 1 (that is, if the original image is of the same size as or smaller than the display screen of the mobile phone 1), the process directly proceeds to step 104. In step 104, HTML data is generated without scaling of the image. The generated HTML data is output to the mobile phone through the HTML output processing unit 31 (step 105). Here, the whole image is displayed by default, because the image does not need to be enlarged. If the original image is larger than the display screen of the mobile phone 1 but can fit into the display screen with a predetermined reduction in size (for example, a reduction percentage of 30% or more), it is reduced by that percentage.

[0070] If the comparison in step 101 shows that the original image is larger than the display area of the mobile phone 1 and would require a significant reduction to fit into the display area (for example, a reduction percentage of less than 30%), the image processing unit 33 generates partial reduced images. The partial reduced images are generated by dividing the original image into partial images corresponding to the key arrangement of the ten-keys 11 and reducing each of the obtained partial images, for example, to {fraction (1/9)} of the display screen, so that they fit into the display screen of the mobile phone 1 when arranged in the same way as the keys (step 102, 103). Then, the layout processing unit 32 arranges the partial reduced images in the same way as the ten-keys 11 and generates HTML data in which corresponding keys in the ten-keys 11 are assigned to the partial reduced images as the access keys and the partial reduced images are arranged in the same way as the ten-keys 11 (step 104). When generating the HTML in step 104, the layout processing unit 32 sets link destinations for keys that are not defined as the access keys for the partial reduced images (the keys “0”, asterisk, and pound) to cause an alarm when pressed. The generated HTML is output to the mobile phone 1 through the HTML output processing unit 31 to allow the mobile phone 1 to display the partial reduced image group as shown in FIG. 4 (step 105).

[0071] Thus, the user can transfer to the enlarged images by selecting the ten-keys from 1 to 9 that have their positional relationships associated with the partial reduced images.

[0072]FIG. 12 describes processing performed by the web server 3 when a ten-key is pressed while the partial reduced image group as shown in FIG. 4 or an enlarged image as shown in FIG. 5 is displayed on the mobile phone 1. This flowchart represents a part of the program stored in the memory 73.

[0073] When a certain ten-key is pressed on the mobile phone 1, information on a link destination assigned to the pressed ten-key is sent to the web server 3. The web server 3 checks the link information (step 110).

[0074] If the link destination for the link information checked in step 110 is an enlarged display image (if one of the keys “1” to “9” in the ten-keys 11 is pressed while the partial reduced image group is displayed, or if a key for causing display of another enlarged image is pressed while an enlarged image is displayed), a corresponding partial image is extracted from the original image: the extracted partial image is scaled to the size of the display screen, and therefore an enlarged image is generated (step 111, 112, 113). Then, HTML is generated for displaying the generated enlarged image (step 114). The generation of the HTML for displaying the enlarged image includes defining the corresponding key number as the access key for displaying the partial reduced image group so that the display returns to the partial reduced image group when the same key is pressed again. The generated HTML is then output to the mobile phone 1 (step 115). While the enlarged image is displayed, the reduced image group is temporarily stored in the memory 73 for a quick return to the display of the reduced image group.

[0075] If the link destination for the link information checked in step 111 is a reduced image group because the same key is pressed again after an enlarged image is displayed on the mobile phone 1 (for example, if the key “1” is pressed again after the key “1” is pressed to display a corresponding enlarged image), the partial reduced image group temporarily stored in the memory 73 is read (step 111, 117). Then, HTML for displaying the partial reduced image group is generated (step 114) and output to the mobile phone 1 (step 115).

[0076] If an enlarged image corresponding to the link destination for the link information checked in step 111 cannot be displayed (for example, if the key “0”, asterisk, or pound is pressed), an alarm message is generated for display with the partial reduced image group (step 116). Then, HTML for displaying the alarm message with the partial reduced image group is generated (step 114) and output to the mobile phone 1 (step 115).

[0077] Thus, according to this embodiment, only a required enlarged image is generated when it is to be displayed. Therefore, besides the advantages provided by the First Embodiment, this embodiment can provide reduction in the processing load on the web server. Further, the amount of a memory area to be used is reduced.

Other Embodiment

[0078] In the above description of the First Embodiment and Second Embodiment, returning from the display of an enlarged image to the display of the partial reduced image group is done by pressing the same key as the key pressed for displaying the enlarged image. On the other hand, in Other Embodiment, a key that is not used for designating an enlarged image (for example, the key “0”, asterisk (*), or pound (#)) may be defined as the access key for returning to the partial reduced image group. In this case, pressing other keys that are not used for designating the enlarged images or the partial reduced image group causes an alarm message to be displayed.

[0079] In this manner, a common key can be used to return from any enlarged image part to the partial reduced image group.

[0080] As many apparently widely different embodiments of the present invention can be made without departing from the spirit and scope thereof, it is to be understood that the invention is not limited to the specific embodiments thereof except as defined in the appended claims. 

What is claimed is:
 1. An apparatus for outputting an image comprising: dividing means for dividing an image so that one of partial images can be selected with a ten-key; and output means for outputting the one of the partial images selected with the ten-key, wherein the dividing means divides the image based on an image size and a screen size.
 2. The apparatus according to claim 1, wherein, when the one of the partial images is selected with the ten-key, the dividing means enlarges the selected partial image based on the screen size.
 3. A method for outputting an image comprising the steps of: dividing an image so that one of partial images can be selected with a ten-key; and outputting the one of the partial images selected with the ten-key, wherein the step of dividing comprises dividing the image based on an image size and a screen size.
 4. The method according to claim 3, wherein the step of dividing comprises, when the one of the partial images is selected with the ten-key, enlarging the selected partial image based on the screen size.
 5. An apparatus for outputting image data comprising: dividing means for dividing an original image into partial images so that one of the partial images can be selected with a ten-key; and output means for outputting a first image data for displaying the one of the partial images selected with the ten-key, wherein the output means outputs a second image data for displaying the whole of the original data in response to a ten-key operation performed when the one of the partial images is displayed.
 6. The apparatus according to claim 5, wherein the output means outputs the second image data for displaying the whole of the original data in response to an operation of the ten-key corresponding to the one of the partial images being displayed.
 7. A method for outputting image data comprising the steps of: dividing an original image into partial images so that one of the partial images can be selected with a ten-key; and outputting a first image data for displaying the one of the partial images selected with the ten-key, wherein the step of outputting comprises outputting a second image data for displaying the whole of the original data in response to a ten-key operation performed when the one of the partial images is displayed.
 8. The method according to claim 7, wherein the step of outputting comprises outputting the second image data for displaying the whole of the original data in response to an operation of the ten-key corresponding to the one of the partial images being displayed. 